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Polvphonic/chordic annotation method 
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BACKGROUND OF THE INVENTION 
A. Field of the Invention 

The present invention relates to a novel chordic progression programmatic 
10 annotation method or concept, which can be implemented with regard to many types of 
standardized keyboards and instruments for more pleasing intonation, tuning and recital, 
with more ease and bettertempo, nuance, articulation and phrasing. The term instruments 
includes all types of devices having a keyboard, for example, mobile phones. 

15 B. Discussion of Related Art 

Chordic keyboards have been proposed in replacement of the standard QWERTY 
keyboard, and are based on the fact that a user can actuate several keys simultaneously 
to signal a certain symbol to the instrument or device whereto the keyboard is connected. 
Such chordic keyboards have been given a special design, adapted to the fingers of a 

20 user, for example U.S. Pal No. 4,360,892, 4,442,506 and 4,443,789 to Endfield et at 
suggests a portable word-processor with a chordic keyboard having four finger keys and 
at least one thumb key with chord assignment being based on the pictorial relationship of 
the keys to letters and punctuation marks. Another specifically designed chordic keyboard 
is disclosed in U.S. Pat No. 5,993,089 to Burrel, based on the 8-dot Braille arrangement. 

25 A dual chordic keyboard is disclosed in U.S. Pat. No. 5,493,654 to Gopher et al, 
comprising two individual and specifically designed co-acting keyboards, each one having 
seven keys, divided into two groups (three and four keys respectively). A further chordic 
data input device having an extremely specific shape and location of the input keys is 
disclosed in U.S. Pat, No. 5,432,510 to Matthews, intended to be operated with one hand 

30 only. 

All of the above patents are based on the use of specifically designed keyboards, 
but do not disclose how existing standardized keyboards can be used, e.g. the keyboard 
of a mobile telephone. There are also other types of keypads used for input of user data 
35 which are restricted to numerical data, e.g. entrance surveillance systems, and such 
systems would obviously be more user friendly, provided that alphanumerical data could 
be inputted rather than only numerical data. 



SUMMARY OF THE INVENTION 



The present invention makes use of a conventional keyboard for extended input of 
information, e.g. a conventional numerical keyboard with 12 keys can be used as a 
conventional numerical keyboard, but may also be addressed as a chordic keyboard, in 
which case simultaneous use of two keys makes it possible to input the entire alphabet as 
well as a large selection of punctuations and other symbols and functions. 

With regard to mobile phones, the ability for a user to send text messages (SMS 
and/or "mobile Internet", "e-mail", etc.) after menu-choice is severely restricted by existing 
method of input, i.e. each key is singularly associated with a number of letters. For 
example, with regard to a Swedish mobile phone, the digit "2" may include the following 
sequence: A, B, C, 2, S, a, 3, a, Q, A. This means that "A" can be obtained by 
depressing the key U 2 M once only, whereas "A" would require that the user depresses key 
"2" eleven times in a rapidly performed operation. 

The present invention makes it possible for a user of a mobile phone to enter a full- 
toned text message etc. in a fraction of the time presently required, and the user can 
master the chordic keyboard in a minimum of time. The modification required to a mobile 
phone to accept and interpretate multikey input is minimal, predominantly of programmatic 
nature, and is easily performed by those skilled in the art. Many keyboards already include 
a diode matrix or similar, from which the result of multikey operation is readily available. 

In a preferred embodiment, the result of various key combinations are disclosed on 
or adjacent to each key, whereby the result of a combination of adjacently located keys is 
readily available to a user. 

According to a further embodiment, the keyboard can also be used to input musical 
notes and facilitate phrasing, harmony, beat and tempo. For example, a mobile phone may 
in fact be operated as a musical instrument, rather than just giving out the tones today 
associated with each key. The music played can be stored in the memory of the mobile 
phone (from which it can be downloaded into a PC for further arr.) ( and may also be 
displayed as musical notes in the display of the phone. 

According to ianother further embodiment the concept of the present invention is 
applied to numerical keyboards as used for entrance surveillance systems, or input of user 
pin codes etc. in various types of systems. As a result, the level of security is considerably 
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enhanced by chordic addressing. For example, code locks often require input of four digits, 
and as a result, a close look at the keypad will often disclose the keys that are used 
frequently, and an unauthorized person may thereby be given the opportunity to find the 
correct combination by the trial-and-error method, i.e. by combining a small number of 
5 frequently used keys in different ways. However, by using the alphanumerical input system 
according to the present invention, a considerably larger number of keys will be used, 
thereby making it far more difficult for an unauthorized person to obtain correct code by 
trial-and-error. Furthermore, alphanumerical input makes it far more easy for a user to 
remember the required code, even If same should involve more than four characters, since 

10 utilized codes can be conventional words, e.g. "attack", "bluebird" etc.. By including a 
"CAP" ("shift") feature, such code words would be even harder to guess, e.g. "aTTack", 
"BluEbird" etc.. This "CAP" can be occasionally ordered by the user on indicated key(s). 
However, in many cases menu-choice etc. to enter into alphanumerical mode should not 
be necessary, since even if the depressed key alone gives both digit (e.g. "1") and letter 

15 (e.g. "a") the required alphanumerical code (e.g. in Sweden used ticket booking code 
format u abc 1 23 d") itself would decide whether letter or digit was intended at actual code 
position; and with uncompromised level of security, but simplifying the use. Furthermore, 
an all numerical code would ignore letters, and a verbal would ignore digits for single keys 
depressed. This ability of the recipient (man or machine) of a message/code, to selfdeduct 

20 what was meant with a single key's depression therein, would in fact, and in a simplest 
form, make it possible to relatively quick write alphanumerical messages/codes by DTMRs 
to call recipients by means of an ordinary telephone, if same is construed thus, that it can 
bring forth also two (or more) DTMF-digits at same time, and the call recipient is equipped 
to decode the resulting tonal chords. Such an ordinary telephone would advantageously 

25 include a small display unit, e.g. 5-10 characters, showing the inputted characters, and 
if equipped with a suitable memory for storage of inputted code, the message can be 
stored off-line prior to establishment of a call. This could also make it possible for a 
similarly constructed mobile phone to bypass SMS, etc., e.g. downloading a called PC. 
This is all technically readily achievable, e.g. just by slight changes in the addressing mode 

30 and the subsequent reacting of the already existing DTMF-transceivers, automatic dialling 
circuits, displays, memories etc. of modern telephones (and on the market, e.g. as 
components); and in the mobile case also by such program changes in the base station 
that it also can perform such multi-DTMF:s. 

35 A non-restricting example of an embodiment according to the present invention, 
implemented in connection with the keyboard of a mobile phone, is more fully described 
below with reference to the accompanying drawings, in which: 



Fig. 1 shows a plan view of the keyboard, including signs disclosing the result of 
different key combinations; and 

Fig. 2 is a table disclosing the result of various key combinations. 

5 

As disclosed in Fig. 1 , a conventional numerical keyboard of a mobile phone includes ten 
numerical keys (0 - 9) and two additional keys, u * u and T respectively, which herein also 
will be called "numerical". A mobile phone also includes other keys, such as "connect", 
"disconnect" and keys related to a menu system, but in a preferred embodiment, these 
1 0 other keys are not used. 

In order to implement the invention, the keyboard must be arranged to recognize and 
decode simultaneous depression of more than one key, and this can be accomplished in 
many known ways. As used here, "simultaneous" also includes "arpeggio" or "broken" 
15 chords, i.e. a second key is depressed while the foregoing is still in depressed position, 
giving eventual consonance. 

A user enters alphanumerical mode by choosing this from the menu system, and such a 
choice may. for example, include entries into a telephone book system, entries to be sent 
20 as text messages, etc. 

When in such a mode, the keyboard will accept chordic entries, and an example of how 
the keys can be used is shown in Fig. 1 . In this particular example, the keyboard can be 
operated in three modes, alphanumerical, CAP and DIG. When in alphanumerical mode, 
25 the "1" key alone results in "a", "1" and "4" results in V and T and "T results in V. In a 
similar fashion, the "2" key can generate "d n , tt e" ("2" + u 5") and T ("2" + "3"), whereas the 
"rim-key" in this embodiment just gives "g° and "h" ("3" + u 6"). The result obtainable from 
remaining keys can be seen from the letters enclosed within an ellipse at each key. 

30 When a user requires capital letters, the CAP (equivalent to "shift* on QWERTY 
keyboards) keys ("7" and "9") are depressed simultaneously, and a subsequent letter will 
be written as a capital letter, i.e. with regard to the keys mentioned above, the "1" key 
results in "A". "1 + 4" results in B B 0 and "1 + 2" results in "C D ( etc.. Next letter will be small 
again unless CAP was pressed twice, effectuating "CAP lock", which gives constant 

35 capitals, until disenabled by yet another CAP strike. 



The user may also require to input numbers and other signs or symbols, and may enter 
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a third and numerical mode be depressing the DIG keys ("*" and u #") simultaneously, in 
this mode, depression of one key only will result in the normal input result for the keyboard, 
i.e. "1 , 2, 3 . . . 0" and the symbols and Also this mode can be permanented by two 
DIG strokes; disenabled by yet one more. 

5 

In ail of the above modes, or if preferred in one or more of the modes, the keyboard can 
also generate other characters or actions. With regard to the example shown in Fig. 1 , this 
can be exemplified by simultaneous depression of keys "7" and *0" in order to obtain the 
symbol "=". and u 8" to obtain V, "5" and "0" to get T, and "0" and H 9 U in order to obtain 
p . 10 "§\ Certain actions can also be accomplished, e.g. "move right" by depressing "1 " and "5", 

Jl "move left" by depressing "2" and V, "move down" by depressing "1 " and "3" and "move 

£ ! up" by depressing "4" and °6". 
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With regard to the example shown in Fig. 1 , it is obviously possible to enhance the number 
15 of signs and actions, since only two keys require simultaneous depression in order to 
obtain the complete Swedish alphabet (capped and non-capped), all digits and numerous 
other symbols/actions, and also not all possible wider interval two-keys chords have been 
employed. By increasing the number of simultaneously depressed keys, e.g. allowing 
combinations of three or more keys, the total number of characters and/or actions (e.g. 
20 menu-choice, programming instructions) can be further increased. Such combinations of 
more than two keys can also be used to represent common words, e.g. "please", "meet", 
"call", "bye" etc., and such commonly used words, including the name of the user, can 
advantageously be preprogrammed into the memory of the mobile phone by the user. 
Preferred such muKikey combinations include three adjacently located keys, for example, 
25 "1+2+3", "1+4+7", "4+7+*°, "1+5+9", "4+8+T, etc, but also other combinations can be 
used, e.g. "1+8+3", "7+2+9" etc. 

Combinations of more than three keys are also possible, preferably based on the use of 
one included common key (e.g. "** or in order to simplify input. However, the number 

30 of simultaneously usable keys is related to how close the keys are located and should 
therefore be related to utilized keyboard type. Furthermore, "broken" chords can be 
differently interpreted depending on which key is depressed first in a given chord. E.g. 12 
is here different from 21; a difference not detectable when the keys are depressed 
isochronally. However, in order to achieve a user-friendly "standard", over-complication 

35 should be avoided, at least for not "high security" applications. 



The keyboard shown in Fig. 1 is adapted for use in Sweden, and letters, symbols etc. can 
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obviously be adapted to country of use (e.g. Cyrillic, greek) or signs/symbols for specific 
purpose of use (e.g. musical notes and symbols). All or some of peripherally located 
indications for the result of different two-keys combinations can likewise be altered (e.g. 
shown on a replaceable key-surrounding shell or an (exchangeable) inscribed membrane) 
5 and/or when "CAP" and/or "DIG" are effectuated, which may widen the gamut of available 
characters/actions substantially. 

The alphanumeric^! use of a mobile telephone keyboard can also advantageously be 
combined with speech synthesizing circuits in the telephone, whereby every entry made 
1 0 is stated audibly to the user. This would enhance the use to persons having restricted eye 
sight capability, and would also be of assistance to other users, e.g. when operating the 
keyboard during mobile conditions. 

Other keys, not included in the 3 x 4 numerical keyboard section, such as "conned", 

1 5 "disconnect" or keys associated with menu choice, can also be given other meaning when 
the keyboard is used for input of text, symbols or music. Such an alternate meaning may 
be obtained individually or as combinations of keys. Furthermore, when there is a key 
arrangement on the keyboard serving as a four coordinates "joystick", same can alone 
advantageously be used to maneuver the cursor when inputting a message, i.e. to move 

20 back or forward, or up and down in the message, and in chordic combination with a 
numeric key, to give any chosen out of four characters/actions inscribed on that key, which 
by itself then can give its numerical sign. Thus, if on the u 1" key the digit 1 is surrounded 
by "a", V, V and °d* in a cross configuration resembling that of the four ar- 
rows/coordinates of the "joystick*, a 1" itself gives M"; M 1" + - gives V; 1 + i gives V; "1" 

25 + -* gives u c D ; and "1 " + J gives M d", All twelve numerical keys can similarly carry four 
characters each, which may bring the English alphabet to end at key T' (as "7" + I), 
leaving room for twentytwo more on-key characters such as "0 U ( U = B and T. By e.g. a 
"shift" ("CAP") command the letters can become majuscules and the symbols can be 
altered. The earlier herein described "move right 11 etc. actions are substituted by the 

30 "joystick" itself, and many/all of the other described "peripherally located indications" can 
move up on-key. 

If one especially with mobile phones wants to retain their present labeling standard (where 
key "2" with u abc u starts the alphabet, and u 7" has "pqrs°, etc.), it is seen that this is readily 
35 feasible; in the joystick case e.g. by just arranging the letters suitably around their present 
digit, optionally filling out vacant positions/keys with more characters, and then write 
chordicly as just above described; and without joystick e.g. thus, that key "2" alone (in 
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writing mode) gives "a". "2" + "5"-chord = V and *T + u 3" = c, etc. for keys tt 4'\ tt 5" and "8", 
key "3" gives "d* and V as per key a 2" and T by "3" + U 4 M , etc. for key a 6", key "7" gives 
(apart from W as per key "4") V by "7" + T , whereas y = "9" + "4" and V = u 9" + H * H . 
In this latter case, the earlier herein described "peripherally located instructions" can be 
5 retained, and can now unlettered keys carry some wanted extra characters, for chordic 
take. 

Calculators etc. very often have a core of 3 x 4 numerical key configuration, surrounded 
or sided by various functional keys, but here, as well known, the numbering orders is 

10 somewhat reverse to that of the telephone. Nevertheless, also here alphabetization can 
be applied according to the herein described chordic concept, starting from either end of 
the numbering, and which can give some advantages, especially with those calculators, 
cash registers, fax machines, ATM:s, automates, etc. having a printer, which then also can 
print out extemporized verbal information, memos, etc.; the numbering order itself of 

15 course not being a critical factor. Also handheld (industrial) programmers quite often has 
like keyboard configuration and numbering order, and they too can make good use of the 
herein described chordic concept, especially since they have regular PC-interface, 

Many such programmers, but also some mobile phones (e.g. Sony Z5), have a regular 3x4 
20 numerical keyboard layout completed at right side with a vertical row of four "function" keys 
to form a standard 4x4 configuration. If these extra keys are employed too in the herein 
described chordic concept, also keys "3", "6" and p 9" could carry three letters each, and 
could repeat the suggested and preferred chordic pattern from e.g. key *T\ and thus the 
spelling would become all symmetric and homogeneous, and V would be reached at key 
25 "9" (as "9" + 'telephonic* numbering order), leaving room for typically seven more on- 
key characters. 

Already today and certainly with "next generation" (Internet) TV:s, home appliances, car 
locks, security/alarm panels, etc., there is a need for comprehensive verbal communication 

30 and input to such devices, either then by voice commands (which takes much data power), 
by mobile phones (IR, Bluetooth, etc.), or most plainly by so called remote controls, which 
two later alternatives are much facilitated by the present invention. It has been shown here 
how mobile phones can be chordically verbalized, but the herein disclosed method can 
also advantageously and readily be implemented at quite modest remote controls having 

35 a 3 x 4 core or other standard configuration keyboard core; e.g. 3 x 3, which just may 
require some extra two-keys wider interval chords and three letters per key to accomplish 
alphabetically, and some rearranging of other indications/instructions shown in Fig. 1 to 
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assist in the writing. 

According to an embodiment, the keyboard is used to create music, in which case the 
keys, and combination of keys, are used to create different tones, combinations of tones, 
5 and musical effects. The created music can advantageously be stored in a memory, and 
with regard to mobile telephones, used as an individually created ring signal. Enhanced 
music input and output capability can be obtained by use of music synthesizing circuitry, 
as known to those skilled in the art, 

10 The popular handheld computers, e.g. Palm™, can also utilize the input method of the 
present invention. There are fbldable QWERTY keyboards on the market, intended to 
simplify text input. However, even though these keyboards are of a fairly small size when 
folded together, they are not easy to operate during mobile conditions. According to the 
present invention, such a handheld computer can be equipped with an integrated or 

1 5 detachably connected small keyboard, e.g. 3x4 keys, possibly a membrane keypad in the 
cover plate, and such a keyboard, operated according to the present invention, would 
simplify input of text (and digits) considerably. Most handheld computers are equipped with 
an serial or parallel interface facilitating connection to a docking unit, and such an interface 
makes it easy to attach/connect the above mentioned keyboard. Here, as well as at other 

20 instalments having a touch-sensitive display, the keyboard can also be vlrtualized and 
enacted on the display itself, and then be of enough size for direct finger touch. If the 
"keys" and indications are displayed semitransparent, the input can be displayed in optimal 
size at the same time and space. As an alternative, and in particular with regard to 
handheld computers having a color display, the layout of the keyboard can be shown on 

25 the display in one color, e.g. red, and the text entered by a user can be shown in another 
color. 

The present invention, disclosing how the use of a conventional small numerical keyboard 
can be considerably enhanced, is thus in no way restricted to mobile telephones only, but 
30 can be implemented with regard to any small size keyboard, e.g. standard 3 x 3, 3 x 4 or 
4x4 keys, in order to increase the input versatility of same considerably. Any additional 
keys available on the keyboard can be used to further enhance the input capability. 

One single keyboard can also be used for different purposes, e.g. input of text, numerals 
35 and symbols when set in a first mode, and to facilitate input of music when set in a second 
mode. Different keyboard overlays can be used for each mode in order to assist a user. 
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The described embodiment, relating to a mobile telephone, is only intended to disclose the 
concept of the invention, since the described technique can be used to increase the 
versatility, security and use of substantially any standardized keyboard as presently used 
for input of a restricted number of characters, normally numerical characters. Conse- 
quently, the other herein mentioned embodiments/applications should be seen as 
illustrating rather than restricting the invention. 

Accordingly, the present invention is in no way restricted to the preferred example of an 
embodiment described with reference to a mobile telephone, since the concept of the 
invention advantageously and readily can be used in connection with many other systems, 
requiring user input. 

The method or concept of the present invention will no doubt also increase business and 
sales of a large number of devices, e.g. handheld computers would appeal to a larger 
group of consumers provided that input of characters could be made in a fast and easy 
way via a small sized keyboard, rather than with use of a pen or an unfolded fairly large 
keyboard. The possibility of increased sales also apply to other types of devices, and as 
disclosed would mobile telephones and conventional telephones be able to accept input 
of text messages in a simple and fast fashion that would appeal to users. The disclosed 
method may therefore also be regarded as a business method, since same would result 
in increased business for a large number of different types of devices. 



